Evaluation of user reactions to a prototype on-line information retrieval system. NASA CR-918.

Distribution of this report is provided in the interest of information exchange. Responsibility for the contents resides in the author or organization that prepared it. SUMMARY Reactions of a user population (scientists/engineers and librarians) to an operational test of an on-line system for retrieving document citations (RECON) were studied at several NASA facilities. During a two month operational test period, data were collected regarding frequency of usage and degree of success encountered in conducting on-line searches. Additional data were gathered by observation, interviews, questionnaires and controlled experimental tests concerning those features of the system which were most acceptable to the user population and the adequacy with which this system could retrieve citations in comparison with off-line machine search methods. The user population used the system extensively (better than 6,000 searches in 6 weeks) and is interested in the implementation and extension of such a system. Results indicate, however, that users are extremely critical of system deficiencies such as down time, and response time. Included with the results, and conclusions, are suggestions by users of desirable features to be included in advanced information retrieval systems.